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Abstract 

We present a method to infer network connectivity from collective dynamics in networks of synchronizing 
phase oscillators. We study the long-term stationary response to temporally constant driving. For a given 
driving condition, measuring the phase differences and the collective frequency reveals information about 
how the oscillators are interconnected. Sufficiently many repetitions for different driving conditions yield 
the entire network connectivity from measuring the dynamics only. For sparsely connected networks we 
obtain good predictions of the actual connectivity even for formally under-determined problems. 

PACS numbers: 05.45.Xt, 89.75.-k, 87.18.Sn, 87.10.+e 
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Synchronization of networks of coupled units is an ubiquitous phenomenon in nature. It oc- 
curs on very different temporal and spatial scales in a variety of systems as different as Josephson 
junction arrays and networks of neurons in the brain Has . A central issue in current multi- 
disciplinary research is to understand the relations between network structure and network dy- 
namics. Given an idealized model of the dynamics of the individual units and of their interactions, 
what can we tell about features of the collective dynamics depending on the network connectivity, 
say a regular lattice, a random network or some more intricately connected network J2I I2I Q]? 
For many biological systems , su ch as networks of neurons, interacting proteins or genes, and eco- 
logical foodwebs [Q, [Z^l [l^L however, important aspects of the network structure are 
largely unknown such that inverse methods may prove useful. It would thus be desirable to answer 
the reverse question: Can we infer information about the connectivity of a network from controlled 
measurements of its dynamics? 

Here we follow this novel perspective for synchronizing phase oscillators that interact on net- 
works of general connectivity. When driving one or more oscillators, the measured phase dy- 
namics reveals information about the specific connectivity. We demonstrate that and how, given 
a network of N oscillators, each experiment (consisting of driving and measuring) provides N 
restrictions onto the network connectivity that is defined by iV 2 coupling strengths. Exploiting 
this, we reveal the entire network connectivity by repeatedly performing measurements of the dy- 
namics only, under iV independent driving conditions. Furthermore, assuming that real networks 
are substantially more sparsely connected than all-to-all, we extend the method to reliably predict 
the entire connectivity of the network even by a number of experiments that is much smaller than 
the number of units in the network. 

We consider a system of iV Kuramoto oscillators, a paradigmatic model that has been suc- 
cessfully used to understand collective dynamical phenomena in engineering, physics, chemistry, 
biology and medicine lITsi IT7L ITsi fl9L I20I1 . The oscillators are coupled on a directed network 
of unknown connectivity with their dynamics satisfying 

N 

fa = Vi,0 + ^2 J{ i sm (^' ~ fa) + hm (1) 
3=1 

where <f>i(t) is the phase of oscillator i at time t, uj^q its natural frequency and J^- the coupling 
strength from oscillator j to i (Jjj = if this connection is absent). The quantity J i m defines the 
strength of an external signal to oscillator i for driving condition m; it is identically zero, I i;0 = 0, 
if the network is not driven. We define the in-degree k t := \{Jy 7^ | j G {!,..., N}}\ as the 



number of incoming links to oscillator i. 

Consider the stationary dynamics on a phase locked attractor that is close to in-phase synchrony 
and thus satisfies <f>i(t) — <f>j(t) = d^ where the d^ , \d^\ <C 1, are constant in time. Networks 
satisfying > and \uj iyQ — Uj o\ sufficiently small for all i, j exhibit such a stable phase-locked 
state close to synchrony. The phase-locked condition for the free (undriven) dynamics reads 

TV 

= ^i,o + Ji i sin (^o - <t>i,o) (2) 

3=1 

where f2 is the collective frequency. 

For synchronizing systems, commonly only one or a few scalar quantities (such as one complex 
order parameter) are computed from measured dynamical data (such as the oscillators' phases), 
often resulting in a statistically accurate description of the overall network dynamics. Here we 
take a complementary approach and seek a more detailed description of the network dynamics in 
order to exploit this information for revealing network connectivity. 

We drive one or more oscillators in the network by temporally constant input signals I^ m , 
i E {1, . . . , iV} that can be positive, negative or zero (meaning that oscillator i is not driven). 
Such inputs effectively change their natural frequencies. Keeping the signal strengths sufficiently 
small, we structurally perturb the phase-locked state such that it stays phase-locked and close to 
the original (cf. Fig. [l]). Such a driving signal results in a phase pattern of the entire network that 
depends on the details of the connectivity of that network as well as on the driving signal itself 
flflllflEl.E]- The perturbed phase-locked state satisfies 

N 

= U} it o + ^ J iJ sin (^i,m _ + h,m (3) 

3=1 

for alH G {1, . . . , iV} where now VL m is the new collective frequency that has changed due to the 
driving and 0j m are the stationary phases in response to the driving. 

Now take the differences between the phase-locked conditions for the driven and the undriven 
system, 

N 

A,m = J y [ sin (^'. m ~ ~ sin (0i,o - <f>i,o)] (4) 

3=1 

where D im := Vt m — Vt — For sufficiently small structural perturbations we approximate 
sin(x) = x + 0(x 2 ) and abbreviate the phase shifts 6j m := <f)j >m — (f)j t o yielding 

N 

Dim ^ Jij@j,in (5) 
3=1 
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Figure 1: (color) Driving induces phase patterns, implicitly denned by Q. The network has N = 16 
oscillators, each connected with a constant coupling strength Jij = l/ki to ki = 8 randomly selected 
others (Jij = otherwise), (a) Homogeneous frequencies, Ui = 1; (b) inhomogeneous random frequencies 
LOi G [1, 1 + Alu], Alu = 0.1. Both panels display the phase differences Afa := maxj{0j} — <pi in the 
phase-locked states versus i. The responses to three different driving conditions, (blue O) one oscillator 
i = 5 driven, /51 = 0.3; (red O) two oscillators i £ {2, 8} driven, ^2,2 = ^8,2 = 0.3; (grey •) all 
oscillators driven by a signal of random strength 1^3 G [0, 0.3] are shown along with the undriven dynamics 
(X). 



where j is the N x N Laplacian matrix is given by 



J, 



J, 



ij 



for i 7^ j 



ij 



(6) 



Given one driving condition m, we measure iV — 1 independent phase shifts i;m and one col- 
lective frequency Vt m to obtain N linearized equations © that restrict the N 2 dimensional space 
of all possible network connectivities (</y)i,je{i,— ,JV}- This is the maximum number of restrictions 
one can deduce from one experiment. As a consequence, from measurements under linearly inde- 



Figure 2: Inferring connectivity from measuring response dynamics. M = N = 16 experiments [24]. (a) 
Connectivity of the network of Fig la as obtained using Eqs. (|5j0- The matrix of connection strengths 
Jij is gray-coded from light gray (J^ = 0) to black (Jjj = maxj'j/{Jj/j/}). (b) Element-wise absolute 
difference |J° ng - Jf/ rived |, plotted on the same scale as (a). Inset shows magnified difference 100 x 
^original _ jgrived | with a cutoff at unity (black). Panels (c) and (d) are analogous to (a) and (b) for the 
network with inhomogeneous frequencies of Fig. lb. 

pendent driving conditions, we obtain more and more information about the connectivity: After 



performing M experiments [26] the space of networks is restricted by MN equations 

D = J6 (7) 

where 9 = (^, m )i G {i,...,Ar}, mG {i i ...,M} is the N x M matrix of column vectors of phase differences 
for each experiment m and, analogously, D = (D i:rn ) ijrn is the N x M matrix of the effective 
frequency offsets. Thus we are left with an (N — M)iV-dimensional family of possible networks 
that are consistent with the M measured data sets. In particular, this implies that after M = N 
experiments the network connectivity is specified completely as given by J = DO^ 1 . We thus find 
the network connectivity from measuring the response dynamics only, see, e.g. Fig. 2. 

This direct method in principle works for networks with homogeneous as well as with inho- 



mogeneous frequencies [25]. The method is capable of revealing not only which links are present 
and which are absent but also gives a good quantitative estimate of the actual link strengths J^. 
It has, however, also some drawbacks. The problem of solving can be ill-conditioned in the 



sense that the ratio of the largest and smallest singular value of 6 T is large, leading to low-quality 
reconstruction. Moreover, the direct method might become impractical when studying real-world 
networks which often consist of a large number N of units and thus would require a large number 
M = N of (possibly costly) experiments. 

Can we obtain the connectivity more efficiently, even with M < N experiments? In many 
networks, such as networks of neurons in the brain, a substantial number of potential links are not 
present: each node i typically has a number k{ <C N of links. Here we exploit this fact and look 
for that connectivity matrix J that has the least number of links (maximum number of = 0) but 
is still consistent with all M measured data sets. 

To achieve this goal we use the constraints Q to parameterize the family of admissible matrices 
by (N - M)N real parameters P i} , i e {1, . . . , N}, j e {M + 1, . . . , N} in a standard way 
using a singular value decomposition of 9 T = U SV T where the M x N matrix S contains the 
singular values on the diagonal, Sy = S^a^ > 0. We rewrite the set of all coupling matrices 
J = DUSV T + PV , setting P i5 = for all j < M and S tj = <Jy/<7< if > 1(T 4 and 5« = if 
Oi < 10~ 4 . Finally, we minimize the 1 -norms of the row vectors of J (input coupling strengths) 

N 

Ji '■= \Jij\ (8) 

with respect to the parameters P, separately for all oscillators i. By this method we find the 
network J that is closest to the origin J = 0, which in 1-norm is one with a minimal number of 
incoming links (maximal number of zero entries) I27I : thus we find the sparsest of all networks 
satisfying the measurement data. Reasonably good reconstructions can already be obtained with 
the number of experiments M being substantially smaller than N, as illustrated in Fig. |3j 

How reliable is such a reconstruction? This depends on the details of the network connectivity 
and the realization of driving. We did a case study for random networks of different sizes N, 
where each oscillator receives input connections from ki = k < N randomly chosen others. 
Using J max = maxj/ j J J^7 ved | , J°", ginal |, define the element- wise relative difference as 



AT ■= 7 _1 



rderived _ xoriginal 
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2 (9) 



such that AJij G [0, 1]. After M experiments, the quality of reconstruction is defined as the 
fraction 

Q a (M) := i H (C 1 - a ) ~ AJ ^) e [°> X ] ( 10 ) 



Figure 3: Revealing connectivity with M < N measurements. Network (N = 64, k = 10, Acj = 0) 
reconstructed by minimizing the 1-norm, (a) M = 38, (b) M = 24. The insets show the element- wise 
absolute differences to the original network. 



of coupling strengths which are considered correct. Here a < 1 is the required accuracy of the 
coupling strengths and H the Heaviside step function, H(x) = 1 for x > 0, H(x) = for x < 0. 
Typically, the quality of reconstruction increases with M (but depends also on the realizations of 
the experiments), becoming close to one already for M substantially smaller than N, see Fig. Hk- 
We furthermore evaluated the minimum number of experiments 

M q , a :=mm{M\Q a (M)>q} (11) 

required for accurate reconstruction on quality level q. Figure |3J) shows M .go,o.95 » the minimum 
number of experiments required for having at least q = 90% of the links accurate in strength on a 
level of at least a = 95%, as a function of N. The numerics suggests that M q>a generally scales 
sub-linearly (presumably logarithmically) with network size N for reasonable < 1 — a 1 and 
0<1 — ?Cl. In particular, it implies that the connectivity of a network can be revealed reliably 
even if M is much smaller than the network size N. 

Recently, the response of synchronizing phase oscil 
has been studied for random networks and lattices 
advantage of the fact that in response to controlled driving (cf . also B21L 
may critically depend on the network connectivity (cf. also Fig. [T]). This is generally the case if 
the networks are strongly connected 112311 but have otherwise arbitrary connectivities (cf. Eq. © 
and [22]). Thus information about the connectivity can be revealed from measuring the response 
dynamics. To achieve this, we exploited all available information of the network dynamics (the 
N — 1 independent phase differences and the collective frequency) rather than only statistical 
information, such as one complex order parameter. Interestingly, in a recent study, Arenas et al. 

7 



ators to different kinds of driving signals 
In the present study we took 
2210 the dynamics induced 




Figure 4: Quality of reconstruction and required number of experiments, (a) Quality of reconstruction 
(a = 0.95) displayed for k = 10 and N = 24 (O), N = 36 (A), N = 66 (o), N = 96 (O) ■ (b) 
Minimum number of experiments required (g = 0.90, a = 0.95) versus network size N with best linear 
and logarithmic fits (gray and black solid lines). Inset shows same data with N on logarithmic scale. 

also used more detailed information of the dynamics and successfully inferred the hierarchical 
structure of a network. 

The method presented here not only identifies where links are present and where they are absent 
but also gives a good estimate for the strength of each connection. For networks with a substantial 
number of potential links absent, we furthermore showed how to predict the connectivity in a reli- 
able way even by a number of experiments that is much smaller than the network size. In fact, the 
numerical evaluation suggests that the number of experiments required for faithful reconstruction 
only scales sub-linearly with the network size. The relatively simple yet efficient method presented 
here thus qualifies as potentially practically useful also for real systems of moderate or larger size 
where the number of measurement might be desired as small as possible. An important question 
for future research is thus how to extend the method presented here to networks of dynamical 
elements that are described by more than one variable and that possibly do not synchronize but 
organize into some other, more complicated, collective state. 

The multidisciplinary research community studying networks has recently seen significant 
progress towards understanding the implications of structural features for network dynamics and 
function, in particular in biological networks. Interesting examples J^, [ll| include (i) net- 
work motifs, small subnetworks that occur significantly more often than in randomized networks, 
have been identified in a variety of complex systems and might be designed for functionality; 

(ii) a small part of a genetic pathway was successfully identified based on expression profiling; 

(iii) neural wiring in the brain appears to follow optimization rules. Together with such find- 
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ings, our results on synchronizing oscillator networks suggest a very promising future direction 
of research: Methods similar to the one presented here should on the one hand help to better 
understand structure-dynamics relations from measuring perturbed, possibly complicated, stable 
dynamics; on the other hand they could also help clarifying structural questions in the first place, 
e.g., by identifying functionally meaningful parts of a network. 

I thank C. Kirst and S. Strogatz for helpful discussions. I acknowledge financial support by the 
BMBF Germany via the BCCN Gottingen under grant 01GQ0430 and by the Max Planck Society. 
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